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FOREWORD 


•v 


The  Individual  Training  and  Skill  Evaluation  Technical  Area  of  the 
Army  Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI)  has 
actively  pursued  a program  of  research  in  support  of  the  systems  engi- 
neering of  training.  A major  focus  of  this  research  is  to  develop  the 
fundamental  data  and  technology  necessary  to  field  integrated  systems 
for  improving  individual  job  performance.  Such  systems  include  Skill 
Qualification  Testing  (SQT) , job  performance  aids,  training  courses  in 
schools  and  in  the  field,  performance  criteria,  and  management  and  feed- 
back systems.  This  report  summarizes  the  first  step  in  the  development 
of  methods  to  assess  and  enhance  the  retention  of  job  skills.  This 
research  is  in  response  to  the  question,  from  the  Army  Training  and 
Doctrine  Command  (TRADOC) , "What  is  the  required  frequency  of  refresher 
training  to  maintain  performamce  proficiency?"  Work  was  accomplished 
by  ARI  personnel,  under  Army  Project  2Q162722A777,  F.y  1978,  "Individual 
Training  Technology."  Comments  and  editorial  assistance  were  provided 
by  Mr.  J.  Doug], as  Dressel  and  Dr.  Joseph  D.  Hagman. 
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RETENTION  OF  MOTOR  SKILLS:  REVIEW 


BRIEF 


Requirement : 

As  part  of  a major  program  on  individual  training  for  combat  i 
ness,  to  develop  a sound  information  base  for  Army  decisions  necessary 
to  insure  soldiers'  long-term  skill  proficiency,  this  review  focuses  on 
retention  of  motor  skills. 


Procedure ; 

This  review  is  based  upon  a wide  variety  of  data  from  an  extensive 
literature  survey  of  pertinent  research.  Although  military-related 
findings  were  incorporated  wherever  possible,  some  of  the  experiments 
cited  used  tasks  having  little  direct  or  obvious  relationship  with 
skills  currently  maintained  within  the  Army.  In  addition,  conflicting 
data  and  data  pertinent  to  a more  detailed  understanding  of  the  behav- 
ioral consequences  of  an  extended  no-practice  period  generally  were 
skimmed  over  to  lend  coherence  to  this  report.  In  so  doing,  an  oversim- 
plified picture  of  long-term  motor  memory  and  the  variables  that  may 
affect  it  has  been  sketched.  These  constraints  notwithstanding,  a num- 
ber of  tentative  conclusions  have  empirical  support. 


Findings: 


1.  The  single  most  important  determinant  of  motor  retention  is 
level  of  original  learning.  Knowledge  of  results  and  response-produced 
feedback  are  thought  to  contribute  most  to  a trainee’s  original  learning. 
Effectiveness  of  the  knowledge  of  results  increases  with  its  availabil- 
ity and  precision.  Effectiveness  of  response-produced  feedback  increases 
with  its  quantity,  for  example,  number  of  feedback  channels  and  amount  of 
practice,  and  fidelity. 

2.  Procedural  tasks  are  forgotten  in  days,  weeks,  or  months, 
whereas  continuous  control  tasks  typically  are  remembered  for  months  or 
■years. 


3.  Retention  of  skill  decreases  with  time,  depending  on  a host  of 
variables,  including  the  length  of  the  no-practice  period,  the  type  of 
task,  and  the  practice  or  interfering  activities  before  or  during  the 
retention  interval. 


4.  Retention  is  improved  by  increasing  the  amount  of  original  prac- 
tice. Overtraining  or  mastery  training  may  be  more  cost  effective  than 
proficiency  training,  that  is,  training  to  one  successful  performance. 

5.  Time  to  retrain  individuals  to  original  performance  levels  is 
generally  rapid,  consistently  less  than  half  the  original  training  time. 

6.  Learners  apparently  can  impose  organization  upon  psychologically 
unstructured  tasks  via  the  learning  process.  As  a result,  task  structure 
is  not  an  important  variable  for  the  long-term  retention  of  well-learned 
responses,  although  it  is  an  impo",.ant  variable  for  the  retention  of  less 
well-learned  responses. 


7.  Functional  similirity  of  the  training  device  to  the  actual 
equipment  is  a necessary  and  sufficient  condition  for  learning  procedural 
tasks. 


8.  Display-control  relationships  can  influence  the  ease  of  motor 
learning  ^nd  transfer  and,  to  some  degree,  the  quality  of  performance 
after  a retention  interval. 

9.  /••.gmented  feedback  can  enhance  performance  by  raising  motivation, 
learning,  or  both. 

10.  Indi'.'idual  ability  levels  are  important  as  determinants  of 
retention  insofar  as  they  influence  a person's  time  to  achieve  a standard 
level  of  performance.  Individuals  of  higher  initial  ability  tend  to 
achieve  higher  levels  of  proficiency  and  retain  skill  at  a higher  level 
than  individuals  of  lower  initial  ability. 

11.  Refresher  training  can  serve  as  an  effective  source  of  new 
learning  as  well  as  a means  for  reestablishing  forgotten  responses.  It 
also  may  provide  a relatively  simple  means  of  improving  on-the-job 
safety  and  performance. 

12.  Learning  and  retention  are  benefited  by  test-taking 
opportunities . 

13.  Positive  transfer  effects  typically  are  observed  when  transfer- 
rin; between  motor  tasks.  Although  negati'  transfer  is  the  exception, 
occasional  intrusive  wrong  responses  inducea  by  past  learning  may  have 
serious  consequences  for  operators  or  equipment. 


Utilization  of  Findings: 

The  conclusions  and  implications  of  previous  research  provide  a firm 
basis  for  specific,  ongoing  programs  to  develop  procedures  that  the  Army 
can  use  to  insure  that  its  personnel  remain  job  proficient  over  prolonged 
periods . 


i 


RETENTION  OP  MOTOR  SKILLS:  REVIEW 


INTRODUCTION 


The  mission  of  the  U.S.  Army  during  peacetime  is  to  maintain  a state 
of  readiness  to  fight  and  to  win  the  first  land  battle  in  event  of  war 
(39).*  To  accomplish  this  mission.  Army  personnel  must  be  equipped  with 
state-of-the-art  weaponry  and  kept  proficient  in  its  use.  Opportunities 
for  sufficient  post-mobilization  training  after  the  onset  of  war  are  not 
expected. 


Establishing  training  procedures  to  develop  proficient  trainees  is 
one  problem;  providing  guidelines  to  maintain  each  individual's  profi- 
ciency is  another.  These  problems  are  interrelated  and  magnified  by  a 
resource-constrained  environment.  Cost-effective  training  demands  that 
the  Army  identify  procedures  that  enhance  proficiency  and  minimize  an  in- 
dividual's requirement  for  "refresher"  training. 


Purpose  and  Scope 


This  review  seeks  to  develop  a sound  information  base  to  facilitate 
Army  decisions  about  ti-aining,  transferring,  and  maintaining  (i.e.,  long- 
term retention)  skills  that  are  critical  for  combat  readiness.  An  infor- 
mation base  would  allow  the  Army  to  (a)  develop  procedures  to  maintain  an 
individual's  proficiency  over  prolonged  no-practice  periods,  for  example, 
weeks,  months,  or  years;  and  (b)  establish  more  accurately  the  optimal 
intervals  for  many  refresher  training  programs. 


The  focus  of  this  review  is  on  the  long-term  retention  of  motor  be- 
haviors because  well-learned,  well-maintained  motor  behaviors  (such  as 
those  involved  in  operating  a tank,  piloting  an  aircraft,  shooting  a 
rifle,  or  launching  a missile)  are  necessary  to  achieve  a guaranteed- 
effective  retaliatory  strike  force.  Of  course,  the  findings  are  equally 
pertinent  to  the  retention  of  less  dramatic  skills  that  are  just  as  im- 
portant for  maintaining  an  effective  Army. 


This  report  presents  a summary  of  an  extensive  literature  survey 
dealing  with  the  variables  known  or  suspected  to  affect  the  retention  of 
learned  motor  behaviors  over  lengthy  no-practice  intervals.  The  sur\'ey 
was  accomplished  using  major  documentation  sources  (i.e..  Defense 


*Numbers  in  parenthesis  refer  to  specific  report  citations  in  the 
References  section. 


Documentation  Center,  Human  Resources  Research  Organization  library, 
National  Technical  Information  Service) , data  bases  (Automated  Data  on 
Instructional  Technology,  Educational  Resources  Information  Center, 
Psychological  Abstracts),  and  a followup  search  of  the  psychological, 
military,  and  business/industrial  literatures. 

Research  conducted  by  or  for  the  military  using  military  personnel 
as  experimental  participants  was  emphasized.  Special  consideration  was 
given  to  research  that  employed  evidently  military-relevant  tasks.  Re- 
search on  tasks  having  few  real-world  applications  was  included  only  if 
the  results  were  practically  indicative  or  suggestive. 


RETENTION  OF  MOTOR  SKILL:  REVIEW 

The  variables  that  may  affect  the  long-term  retention  of  skilled 
motor  performances  were  dichotomized  into  task  variables  and  procedural 
variables.  Task  variables  relate  to  the  trainee  or  to  the  training/ test 
environment,  whereas  procedural  variables  relate  to  the  manner  in  which 
training,  final  testing,  or  both  occur.  Conclusions  drawn  about  each  are 
underscored  in  the  text,  with  important  reservations  and  exceptions  noted. 
Directions  for  future  research  are  suggested  where  the  literature  relating 
to  the  effect  of  a particular  experimental  manipulation  is  ambiguous. 

The  task  variables  that  may  tinderlie  the  long-term  retention  of  motor 
skill  include  (a)  duration  of  the  no-practice  period,  or  retention  inter- 
val; (b)  nature  of  the  response  required  to  accomplish  a particular  motor 
task;  (c)  degree  to  which  the  learner  can  organize  or  impose  order  upon 
the  elements  that  define  the  task;  <d)  structure  of  the  training  environ- 
ment; and  (e)  initial  or  "natural"  ability  of  the  learner  to  perform  a 
task  in  the  absence  of  prior  practice. 

The  procedural  variables  that  may  affect  the  long-term  retention  of 
motor  skill  include  (a)  degree  of  proficiency  attained  by  the  learner 
during  initial  training;  (b)  amount  and  kind  of  refresher  training; 

(c)  transfer  of  skills  from  one  task  to  another  task;  (d)  interfering 
activities;  (e)  scheduling  of  practice  during  training;  (f)  use  of  part- 
task  versus  whole-task  training  methods;  and  (g)  introduction  of  extra 
test  trials  prior  to  final  testing. 


Task  Variables 

Retention  Interval 

The  retention  interval  is  the  period  of  no  practice  between  the 
acquisition  and  subsequent  test  of  a performance.  The  classical  curve  of 
forgetting,  as  depicted  in  Figure  1,  is  believed  to  apply  to  motor 
responses . 


Note  that  the  absolute  amount  frrgotten  increases  uith  time,  whereas 
the  apparent  rate  of  forgetting  declines  v;ith  time.  Of  course,  the  exact 
shape  of  any  forgetting  curve  depends  upon  a host  of  variables  (21)  in- 
cluding (a)  the  amount  of  practice  the  learner  receives  (48,72);  (b)  the 
length  of  the  interval  between  training  and  retention  measurement  (129) ; 
(c)  the  nature  of  the  response  to  be  retained  (14);  and  (d)  activities 
that  interfere  with  acquisition  or  retention  (75) . 


Nature  of  the  Response 

Motor  responses  are  classified  typically  as  either  continuous  or 
discrete,  but  probably  no  response  is  totally  one  or  the  other.  We  will 
define  a response  as  continuous  if  it  involves  the  repetition  of  a move- 
ment pattern  that  does  not  have  a discernible  beginning  or  end.  The  most 
commonly  employed  continuous  taslc  in  studies  of  motor  ir'^mory  is  traclcing, 
presumably  because  it  is  the  response  activity  that  underlies  vehicular 
control  (2)  . 

There  are  two  types  of  traclcing  tas)cs,  pursuit  tracJcing  and  compen- 
satory trac)cing.  In  pursuit  tracking,  the  operator  can  see  both  the  tar- 
get to  be  followed  and  his  tracking  device  or  cursor.  The  operator's  job 
is  to  keep  the  cursor  aligned  with  the  target  so  that  the  discrepancy  be- 
tween the  two  is  nullified.  Keeping  a weapon  sight  (cursor)  on  a moving 
tank  (target)  is  an  example  of  a pursuit  tracking  task.  In  compensatory 
tracking,  on  the  other  hand,  neither  the  target  nor  its  position  is  dis- 
played. The  operator  knows  only  the  difference  between  an  error- 
indicator  and  a fixed  reference,  and  his  task  is  to  nullify  this 
difference. 

For  example,  error-nullifying  principles  are  the  basis  of  certain 
navigational  instruments  that  signal  the  operator  to  begin  directional 
(or  attitudinal)  corrections  if  he  strays  off  the  intended  course.  Also, 
the  "leveling  vials"  used  in  field  artillery  may  be  regarded  as  a kind  of 
compensatory  tracking  device.  By  compensating  for  the  movement  of  an  air 
bubble  (error-indicator)  floating  within  a glass  tube  mounted  on  the  ar- 
tillery piece,  the  gunner  can  adjust  the  artillery  piece  to  a horizontal 
plane . 

A response  is  discrete  if  it  has  a definite  beginning  and  end  and, 
typically,  is  quite  brief  in  duration,  for  example,  less  than  5 seconds 
(117) . Familiar  examples  of  discrete  responses  include  moving  a gear- 
shift, shooting  a rifle,  or  throwing  a hand  grenade.  Procedural  tasks 
typically  are  composed  of  a series  of  discrete  motor  responses.  Usually, 
the  learner's  main  problem  on  each  trial  is  selecting  the  correct  response 
from  a repertoire  of  possible  responses  rather  than  actually  executing  the 
response.  The  learner's  main  problem  is  determining  "what  to  do"  rather 
than  learning  "how  to  do  it,"  for  example,  reassembling  a carburetor  or 
operating  a radio  communications  system. 
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This  need  not  always  be  the  case,  however,  because  certain  proce- 
dural tasks  such  as  playing  the  piano  or  executing  the  Manual  of  Arms 
not  only  require  the  performer  to  learn  to  select  an  appropriate  series 
of  responses  but  to  learn  how  to  execute  them  with  the  proper  force  and 
in  the  proper  time  sequence  as  well. 


Procedural  tasks  and  individual  discrete  motor  responses  are  for- 
gotten over  retention  intervals  measured  in  terms  of  days,  weeks,  or 
months,  whereas  continuous  movements  typically  show  little  or  no  for- 


getting over  retention  intervals  measured  in  terms  of  months  or  years 
Although  support  for  chis  proposition  has  been  obtained  in  a wide  vari- 
ety of  basic  (129)  and  applied  research  settings,  the  most  notable  con- 
tributions have  been  made  by  investigators  concerned  with  the  long-term 
retention  of  piloting  skills  (51,99,100,127).  Studies  dealing  with  the 
maintenance  of  instrument  flying  skills  (9,87),  manned  spacecraft  flight 
operations  (123,124,125),  and  lunar  landing  skills  (38)  consistently 
indicate  that  important  procedural  aspects  of  flight  control  deteriorate 
to  unacceptable  or  unsafe  levels  over  retention  intervals  measured  in 
terms  of  weeks  or  months. 


Altliough  data  are  lacking  with  respect  to  the  maintenance  of  Army 
job-relevant  procedures,  data  on  the  maintenance  of  basic  combat  train- 
ing skills  (83,141),  the  preparation  and  firing  of  a Nike-Hercules  mis- 
sile (54,55),  and  gunnery  proficiency  in  a combat  air  force  (World  War  II) 
(114)  support  the  contention  that  procedural  proficiency  cannot  be  main- 
tained in  the  absence  of  regular  practice. 


Data  on  the  retention  of  continuous  movements  come  from  studies  of 
pursuit  tracking  (19,64,71,103,115,126),  compensatory  tracking  (9,14, 
18,48,87),  and  balcuicing  (88,101,109,115).  In  contrast  to  the  findings 
for  procedural  tasks,  continuous  movements  generally  are  retained  well 
over  prolonged  retention  intervals,  even  in  the  absence  of  practice. 

For  example,  researchers,  using  a part-task  flight  simulator,  found  a 
95%  loss  of  procedural  response  proficiency  over  a 10-month  retention 
interval,  but  found  no  effect  upon  the  retention  of  continuous  flight 
control  responses  (9).  Others  concluded  that,  although  the  forgetting  of 
cockpit  procedures  over  a 4-month  retention  interval  could  impair  a pi- 
lot’s flying  efficiency  and  safety,  this  interval  was  not  sufficient  to 
degrade  a pilot's  continuous  motor  aircraft-control  skills  (87). 


A number  of  hypotheses  have  been  offered  to  account  for  the  differ- 
ence in  retention  of  procedural  and  continuous  movement  tasks  (2,92,129). 
They  are  as  follows: 


1. 


The  verbal-cognitive  nature  of  procedural  tasks  may  make  them 
easier  to  forget  than  continuous  motor  responses. 


2, 


It  is  unclear  what  constitutes  an  individual  trial  during  a 
continuous  performance  and,  as  a result,  continuous  responses 
may  be  overlearned  and  thus  retained  better  than  discrete  motor 
responses . 
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Continuous  responses  may  be  retained  better  simply  because  they 
are  more  integrated  or  coherent  than  procedural  tasks. 


4.  Retention  differences  between  tasks  may  be  partially  due  to  the 
way  errors  are  scored,  that  is,  the  methods  used  to  score  the 
retention  of  discrete  motor  responses  may  be  relatively  more 
sensitive  to  slight  performance  deviations  than  the  methods  used 
to  index  the  retention  of  continuous  responses. 


Regardless  of  which  interpretation  finds  support,  the  observation 
that  procedural  tasks  are  less  likely  to  be  retained  at  an  acceptable 
level  over  a retention  interval  than  are  continuous  responses  has  impli- 
cations for  Army  training.  In  particular,  regular  refresher  training 
must  be  provided  for  tasks  that  emphasize  procedural  knowledge.  A simi- 
lar recommendation  was  made  to  the  Navy  after  a study  was  conducted  on  the 
forgetting  of  procedural  and  continuous  instrument  flying  behaviors  (87) . 
Fortunately,  procedural  tasks  are  typically  less  expensive  and  simpler  to 
train  than  are  continuous  responses  because  procedural  tasks  require  lit- 
tle in  terms  of  equipment  beyond  simple  classroom  training  aids  (54,55). 
Also,  it  is  known  that  verbal  cues  and  written  job  aids  can  facilitate 
the  training  and  maintenance  of  procedural  tasks  (61,81).  Techniques 
based  upon  this  observation  currently  enhance  on-the-job  performance  in 
the  Army  (the  Integrated  Technical  Documentation  and  Training  Program). 
Research  efforts  to  make  written  job  aids  more  accessible  and  easier  to 
understand  are  likely  to  yield  additional  performance  benefits. 


Organization 

Organization  refers  to  the  process  by  which  the  learner  imposes 
order  or  structure  upon  the  elements  that  define  his  task  by  establi..h- 
ing  consistent  relations  among  them  (52) . Evidence  within  the  verbal 
(137)  and  m^tor  (98,131,134,135)  memory  literatures  suggests  that  tasks 
inherently  amenable  t^^  learner  organization  are  learned  at  a faster  rate 
than  less  structured  tasks.  Under  conditions  of  moderate  learning,  highly 
structured  tasks  also  are  retained  at  a higher  level  than  less  structured 
tasks.  Once  learning  reaches  an  advanced  stage,  hov/ever,  individuals 
apparently  can  retain  less  structured  tasks  as  proficiently  as  highly 
structured  ones. 


For  example,  groups  of  individuals  in  one  study  were  trained  to  per- 
form two  tasks  simultaneously.  The  primary  task  was  compensatory  track- 
ing, and  the  secondary  task  involved  learning  either  a highly  structured 
or  less  structured  procedural  sequence.  Training  was  conducted  for  ei- 
ther 2 or  3 weeks  and  was  followed  by  retention  testing  after  either  1 or 
4 weeks.  As  predicted,  retention  of  the  primary  and  secondary  tasks  by 
groups  having  the  highly  structured  secondary  task  was  superior  to  that 
of  groups  having  the  less  structured  secondary  task.  This  effect, 
however,  held  only  for  those  groups  receiving  moderate  amounts  of  train- 
ing. The  structure  of  the  secondary  task  did  net  affect  the  loss  of 
tracking  or  procedural  proficiency  under  greater  amounts  of  training  (94). 
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Thus,  individuals  apparently  can  impose  structure  upon  psycholog- 
ically unstructured  tasks  by  organizing,  but  the  act  of  orgcuiization 
takes  time  and  practice.  Indeed,  the  amount  of  time  and  practice  re- 
quired for  a learner  to  organize  some  tasks  may  be  too  long  for  any 
reasonable  training  period.  If  sufficient  initial  learning  opportuni- 
ties exist,  however,  less  structured  tasks  can  be  retained  as  well  as 
highly  structured  ones. 
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Training  Environment 

A number  of  environmental  variables  have  been  identified  (51)  that 
may  affect  the  long-term  retention  of  military-related  tasks.  Among  the 
variables  are  (a)  the  fidelity  of  training  devices;  (b)  the  compatibility 
of  display-control  relationships,  (c)  the  specificity  of  task  displays; 
and  (d)  augmented  feedback. 

Fidelity.  The  similarity  between  training  devices  and  operational 
equipment  can  be  viewed  from  two  perspectives:  physical  similarity  and 
functional  similarity.  Physical  similarity,  or  fidelity,  refers  to  the 
physical  resemblance,  in  an  engineering  sense,  between  the  displays  and 
controls  on  a training  device  and  those  on  the  operational  equipment. 
Functional  similarity,  on  the  other  hand,  refers  to  the  "degree  of  repre- 
sentativeness" or  "psychological  realism"  of  a training  device  relative 
to  the  actual  equipment  (145) . 

Functional  similarity  is  a necessary  and  sufficient  condition  for 
learning  procedural  tasks.  For  illustration,  the  acquisition  and  long- 
term retention  of  a 92-step  procedural  task  (firing  a Nike-Hercules 
missile)  following  training  on  a high- functional  similarity  drawing  of 
the  operational  equipment  has  been  shown  to  equal  learning  and  retention 
following  training  on  the  actual  equipment  (54,55).  A similar  result 
was  obtained  using  a complex  procedural  communication  task  (20).  A 
comprehensive  overview  of  the  variables  influencing  transfer  from  train- 
ing device  to  operational  setting  has  been  provided  elsewhere  (144,145). 

Display-Control  Compatibility.  Certain  display-control  relation- 
ships appear  to  be  more  "natural"  or  "expected"  for  the  human  operator 
than  others.  This  notion  is  based  upon  the  observation  that  when  several 
display-control  relationships  are  possible  for  a given  eye-hand  coordina- 
tion task,  one  relationship  will  lead  to  substantially  better  initial 
performance  than  the  others  (46) . . The  interpretations  offered  for  this 
effect  suggest  that  compatible  display-control  relationships  are  more 
consistent  with  the  learners*  past’ experiences  with  the  environment 
(1,120)  or  perhaps  more  consistent  with  the  principles  of  human  biome- 
chanics than  incompatible  display-control  relationships. 
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Examples  of  display-control  relationships  that  typify  those  normally 
encountered  in  the  environment  include  (a)  moving  a pointer  to  the  right 
(display)  by  moving  a lever  to  the  right  (control) ; (b)  moving  a pointer 
to  the  right  by  rotating  a )snob  in  a clockwise  direction;  and  (c)  moving 
a pointer  dovmward  by  moving  a lever  forward  ( 86 ) . 

The  compatibility  of  display-control  relationships  influences  the 
ease  of  motor  learning  and  transfer  (1,29,46)  as  well  as  the  quality  of 
performance  after  a retention  interval  (86).  These  results  have  implica- 
tions for  training  and  equipment  design.  Individuals  training  on  high- 
compatibility  equipment  require  less  training  to  achieve  and  to  maintain 
a satisfactory  level  of  perforciance  than  individuals  training  on  equipment 
having  incompatible  display-control  relationships. 

Indeed,  it  is  suggested  that  the  performance  of  individuals  afforded 
a reasonable  amount  of  training  on  equipment  having  incompatible  display- 
control  relationships  may  never  catch  up  to  the  performance  of  individuals 
using  high-compatibility  equipment  (46) . The  compatibility  of  display- 
control  relationships  may  not  pose  serious  problems  during  the  performance 
of  slow,  self-paced  tasks  that  allow  a liberal  margin  for  error.  But  it 
would  be  a mistake  to  expect  optimal  performance  using  equipment  with  in- 
compatible display-control  relationships  in  potentially  dangerous  (120), 
externally  paced,  or  infrequently  performed  tasks. 

Specificity  of  Task  Displays.  Most  tasks,  such  as  tracking,  depend 
heavily  upon  the  processing  of  visual  information  from  a task  display. 

At  least  during  the  initial  stages  of  learning,  the  learner  is  forced  to 
rely  upon  the  visual  cues  he  receives  from  the  task  display  to  guide  his 
performance.  Later  in  learning,  however,  the  learner  relies  more  on  pro- 
prioceptive or  other  internal  sources  of  information  and  depends  less  on 
the  display  and  other  external  cues  (16,49) . This  suggests  that  visual 
cues  designed  to  supplement  the  information  provided  by  the  task  display 
are  informative  early  in  learning  and  facilitate  the  learning  process, 
but  may  be  relatively  uninformative  once  the  learner  has  "internalized” 
the  performance.  This  hypothesis  was  tested  using  a pursuit  tracking  task 
and  task  displays  that  varied  in  "specificity."  Display  specificity  in- 
volved a numerical  code  and/or  several  grid  systems  that,  superimposed  on 
the  face  of  an  oscilloscope,  permitted  several  levels  of  target-location 
cueing  (136) . 

As  predicted,  the  early  acquisition  of  the  tracking  task  was  facili- , 
tated  under  conditions  of  high-display  specificity.  However,  the  speci- 
ficity of  the  display  did  not  affect  the  final  levels  of  skill  attained 
by  the  learners  nor  the  1-month  retention.  Apparently,  later  in  learning, 
supplementary  cues  from  a display  do  not  provide  information  over  and 
above  that  which  is  already  provided  by  internal  sources  and  consequently 
are  not  important  as  determiners  of  retention. 


Augmented  Feedback.  Information  about  a response  may  be  augmented, 
or  supplemented,  by  delivering  general  instructions  or  perceptual  cues  to 
the  trainee  before,  during,  or  after  the  response.  For  example,  if  the 
trainee  can  see  each  time  he  scores  "a  hit"  on  the  standard  task,  then 
saying  "hit"  or  flashing  a light  augments  feedback.  Little  has  been  done 
to  assess  directly  the  effects  of  augmented  feedback  on  the  long-term 
retention  of  motor  responses.  The  only  experiment  found  on  the  subject 
failed  to  find  any  effect  of  supplementary  auditory  noise  upon  the  acqui- 
sition or  retention  of  a compensatory  tracking  task  (33). 

The  effects  of  augmented  feedback  vary  from  task  to  task,  both  while 
the  extra  feedback  is  present  and  in  tests  after  it  has  been  removed  (25). 
When  augmented  feedback  is  present,  it  often  facilitates  performance  dur- 
ing training  (29) . This  facilitation  has  been  attributed  to  changes  in 
motivation  (22) , learning  (102) , or  both  (69) . To  understand  how  these 
interpretations  differ,  see  Figure  2.  The  figure  presents  the  hypotheti- 
cal performance  data  for  two  groups  trained  with  and  without  augmented 
feedback  that  were  transferred,  or  shifted,  to  common  conditions  after  a 
rest  interval.  The  three  possible  outcomes  of  the  transfer  test  are  il- 
lustrated in  A,  B,  and  C (117),  and  are  explained  below. 

Certain  variables,  such  as  motivating  instructions  (47),  stimulate 
or  activate  the  learner  to  perform  previously  learned  responses  more 
vigorously,  but  they  have  no  direct  effect  on  the  strength  of  those 
responses  in  memory.  A variable  that  raises  or  lowers  performance  when 
present  and  whose  effects  disappear  rapidly  when  removed  is  called  a 
performance  variable  (result  A) . 

For  example,  one  experiment  (22)  involved  the  acquisition  of  an  ele 
tronic  antiaircraft  gunnery  tas)^  and  the  delivery  of  augmented  visual 
feedback  during  training.  Individuals  in  the  control  condition  tracked 
each  target  plane  using  a group  of  dots  as  a cursor.  Feedback  was  the 
visual  error  between  the  dots  and  the  moving  target  plane.  Individuals 
in  the  augmented  feedback  condition  performed  the  same  tracking  task  as 
those  in  the  control  condition,  but  they  received  extra  visual  cues 
(reddening  of  the  target  plane)  when  their  responses  were  on  target. 

Individuals  in  the  augmented  feedback  condition  performed  better 
during  training  than  individuals  in  the  control  condition,  but  they  did 
not  learn  more  about  the  task  than  the  controls.  When  subsequently  re- 
quired to  perform  in  the  absence  of  the  supplementary  visual  cues,  indi- 
viduals in  the  experimental  group  performed  no  better  than  those  in  the 
control  group. 

Experience  with  some  variables,  such  as  organizational  strategies 
(52,89),  produces  relatively  permanent  changes  in  performance.  If  the 
effects  of  this  experience  persist  after  the  variable  has  been  removed, 
the  variable  is  said  to  be  a learning  variable  (result  B) . For  illustra- 
tion, researchers  us^ig  a pursuit  tracking  task  in  which  trainees  could 
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see  if  they  were  on  target  found  that  performance  was  enhanced  greatly 
when  feedback  was  augmented  by  a clicker  that  sounded  when  the  trainees 
were  on  target.  The  authors  attributed  this  enhancement  to  learning 
because  the  effect  persisted  after  the  clicker  was  removed  (102) . 

Some  variables,  such  as  knowledge  of  results  (76),  appear  to  affect 
both  performance  and  learning.  For  these  varicibles,  tho  dissimilarity 
between  groups  is  reduced  by  a transfer  test  (result  C) . Some  research 
indicates  that  augmented  feedback  may  work  in  this  v;ay,  at  least  in  cer- 
tain situations  (69) . 


By  definition,  performance  variables  do  not  have  a direct  effect  on 
learning  or  memory.  An  important  reservation  must  be  made,  however.  Any 
variable,  such  as  augmented  feedback,  tliat  can  enhance  an  individual's 
motivation  to  perform  a particular  task  also  may  induce  him  to  practice 
harder  or  more  frequently;  few  doubt  the  importance  of  practice  as  a 
variable  for  learning  and  memory  (6) . Thus,  variables  that  raise  (or 
lower)  a person's  motivation  to  perform  a particular  task  also  may  act 
indirectly  to  determine  what  is  learned  and  what  is  retained. 

In  summary,  a variety  of  training  procedures  has  been  used  to  augment 
feedback.  Some,  but  not  all,  produce  lasting  benefits.  Some  have  no  ef- 
fect on  performance.  Some  conceivably  could  produce  performance  deficits 
when  withdrawn  (25) . It  has  been  indicated  that  the  transfer  paradigm 
provides  a basis  for  evaluating  formally  the  impact  of  training  variables 
such  as  augmented  feedback  on  motor  learning  and  performance.  Informally, 
however,  the  following  generalization  appears  to  have  some  empirical  jus- 
tification as  a guide  for  evaluating  a training  procedure: 

...a  subject  must  have  some  cues  to  the  results  of  his  actions 
if  he  is  to  perform  accurately  at  all,  and  training  procedures 
will  be  effective  insofar  as  they  help  him  to  observe  and  use 
such  cues  as  are  inherent  in  the  task  for  which  he  is  being 
trained.  They  will  fail  insofar  as  they  provide  him  with  extra 
cues  on  which  he  comes  to  rely  but  which  are  not  available  when 
he  changes  from  training  to  the  actual  job  (343). 


Individual  Ability  Levels 

In  the  acquisition  of  motor  tasks,  individuals  having  higher  initial 
ability  levels  generally  require  less  time  to  attain  a specified  crite- 
rion than  individuals  having  lower  initial  ability  levels.  This  conclu- 
sion appears  to  generalize  across  a wide  range  of  military  (50,55,141)  and 
nonmilitary  (35,36,101)  training  conditions  and  a number  of  different  op- 
erational definitions  of  the  tejnn  initial  ability. 


Thus,  research  using  sight  training  task's  ranging  in  complexity  from 
a simple  reaction  time  task  (monitoring)  to  a combat  plotting  task  prob- 
lem solving  (50) , research  using  a 92-step  procedural  task  (55) , and 
research  using  13  Basic  Training  Skills  (141)  all  defined  initial  ability 
in  terms  of  the  trainees'  Armed  Forces  Qualification  Test  scores  and  indi- 
cated faster  learning  by  trainees  who  had  higher  mental  aptitudes.  Other 
studies,  defining  initial  ability  in  terms  of  the  learner's  early  perfor- 
mance on  a to-be-retained  balancing  task  (35,36)  or  using  expert  judgments 
of  motor  proficiency  as  an  index  of  initial  ability  on  five  novel  gross 
motor  tasks  (101)  obtained  analogous  results. 

In  contrast,  the  weight  of  the  evidence  indicates  that  the  rate  at 
which  motor  proficiency  is  lost  is  not  related  to  a performer's  initial 
ability  level  (35,55,101,141).  This  is  illustrated  in  Figure  3,  which 
presents  hypothetical  forgetting  functions  for  three  groups  of  varying 
initial  ability.  Note  that  the  functions  are  parallel  to  one  another, 
suggesting  a common  rate  of  forgetting.  Also  note  that  individuals  of 
higher  initial  ability  achieve  higher  levels  of  proficiency  during  origi- 
nal training  and  retain  their  skill  at  a higher  level  over  the  retention 
period  than  individuals  of  lower  initial  ability  (141).  As  a consequence, 
such  individuals  should  require  refresher  training  less  frequently  than 
persons  of  lower  initial  ability.  Furthermore,  refresher  training  can  be 
shorter  for  persons  of  higher  initial  ability  because  they  retrain  to 
standards  more  quickly  than  persons  of  lower  initial  ability  (55) . 


Procedural  Variables 


Level  of  Original  Learning 

A number  of  authors  (48,51)  have  described  the  learner's  level  of 
original  learning  as  the  single  most  important  determiner  of  motor  mem- 
ory. One  study,  using  a three-dimensional  flight-control  task  (48), 
found  extremely  high  positive  correlations  ‘,.80  to  .98)  between  the 
learner  >'  initial  proficiency  levels  and  later  retention.  This  evidence 
is  compelling  because  the  strength  of  these  correlations  did  not  dissi- 
pate through  time.  The  relationship  between  original  learning  level  and 
retention  remained  high  and  stable  over  retention  periods  ranging  from 
1 month  to  2 years. 

Given  the  importance  of  original  learning  as  a deteiminant  of  reten- 
tion, some  consideration  must  be  given  to  the  variables  rhought  to  con- 
tribute most  heavily  to  the  motor  learning  process.  These  are  knowledge 
of  results,  for  example,  "right,"  "wrong,"  "too  long,"  "too  short";  and 
response-produced  feedback,  for  example,  proprioception,  vision,  and 
audition. 
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Hypothetical  forgetting  functions  for  three  groups  of 
varying  initial  ability. 
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Knowledge  of  Results.  Knowledge  of  results  refers  to  externally 
provided  error  information  about  the  discrepancy  between  a learner's  ac- 
tual response  and  the  intended  response.  Announcements  such  as  "right," 
"wrong,"  "3  inches  too  far"  are  examples  of  knowledge  of  results.  An 
account  of  the  role  of  knowledge  of  results  in  motor  learning  is  beyond 
the  scope  of  this  report;  there  are  several  literature  reviews  available 
on  the  subject  (4,25,97,116).  Two  points  from  that  literature,  however, 
are  especially  pertinent: 

1.  The  early  acquisition  of  a skill  depends  heavily  upon  knov;ledge 
of  results.  Performance  generally  improves  with  knowledge  of 
results  and  deteriorates,  or  shows  no  further  improvement,  when 
knowledge  is  withdrawn  (24,96).  Only  later  in  learning,  once  a 
performance  has  become  "internalized,"  may  knowledge  of  results 
be  withdrawn  (or  its  absolute  frequency  reduced)  without  seri- 
ously impairing  performance  (96,118) . 

2.  In  the  relationship  between  the  amount  of  information  provided 
by  knowledge  of  results  (its  precision)  and  an  individual's  rate 
of  learning  and  final  level  of  performance,  the  consistent  find- 
ing (133)  has  been  that  performance  is  facilitated  by  increases 
■in  the  precision  of  knowledge  of  results,  but  only  up  to  a point. 
If  knowledge  of  results  becomes  too  precise,  that  is,  if  the 
amount  of  information  provided  by  knowledge  of  results  is  in- 
creased beyond  that  which  can  be  processed  by  the  learner  within 
the  time  allowed,  a decrement  in  performance  will  result  (110). 


In  general,  individuals  who  receive  more  and  better  knowledge  of 
results  require  less  training  time  and  achieve  a higher  end-of~training 
performance  level  than  those  who  do  not.  This  suggests  that  any  added 
effort  to  provide  more  or  better  knowledge  of  results  to  trainees  would 
be  worthwhile.  It  also  suggests  that  special  attempts  must  be  made  to 
facilitate  the  delivery  of  knowledge  of  results  in  situations  that  tend 
naturally  to  inhibit  the  presentation  of  its  information. 

For  example,  a major  source  of  difficulty  in  training  many  team  tasks 
is  in  detecting  and  correcting  the  errors  of  individual  team  members.  Al- 
though a variety  of  factors  contributes  to  this  problem,  it  appears  to 
stem  primarily  from  the  interactive  effects  of  the  team  members'  respond- 
ing and  the  difficulties  involved  in  simultaneously  monitoring  the  behav- 
ior of  several  individuals  (142) . If  techniques  could  be  devised  to 
facilitate  the  presentation  of  more  or  better  knowledge  of  results  in 
situations  like  these,  a higher  level  of  trainee  performance  is  likely 
to  be  realized. 

Response-Produced  Feedback.  The  theoretical  status  of  response- 
produced  feedback  during  motor  learning  is  still  controversial  (3,5,67, 

68) , but  few  doubt  its  practical  importance  for  the  acquisition  of  new 
motor  responses.  Most  theorists  (4,67)  contend  that  early  in  learning, 
the  learner  uses  knowledge  of  results  in  relation  with  the  feedback 
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information  he  receives,  for  example,  proprioceptive,  visual,  or  auditory 
cues,  to  establish  a memorial  representation  of  how  a correct  performance 
feels,  looks,  and  sounds.  This  representation  is  assumed  to  be  weak  ini- 
tially, so  the  learner  must  depend  heavily  upon  knowledge  of  results  for 
information  about  the  correctness  of  his  performance  (24,96). 


Later  in  learning,  however,  after  a stronger  represent',-.,,,.,  of  the 
correct  performance  has  been  stored  in  memory,  the  learner  --ti  tact  and 
correct  movement  errors  by  comparing  the  feedback  qualities  ■'  .:*s  present 

performance  with  those  of  the  stored  representation.  He  no  longer  needs 
to  depend  upon  knowledge  of  results  for  information  about  the  correctness 
of  his  performance  (96) . This  information  is  inherent  in  the  feedback 
that  he  has  received  from  past  performances  and  that  he  receives  from  his 
present  performance,  and  the  information  enables  him  to  "know"  when  a 
performance  is  correct  in  the  absence  of  knowledge  of  results. 


The  notion  (4)  that  motor  learning  and  performance  depend  upon  the 
quantity,  for  example,  number  of  feedback  channels  and  amount  of  practice, 
and  quality,  that  is,  fidelity,  of  the  response-produced  feedback  the  in- 
dividual receives  has  solid  empirical  support.  The  more  response-produced 
feedback  that  the  learner  receives,  the  more  accurate  and  confident  he 
becomes  in  his  responding  (6,7,8,119).  Also,  retention  is  facilitated  by 
increasing  the  amount  of  original  practice  or  number  of  available  feedback 
channels,  for  example,  vision  versus  no  vision.  Evidence  for  this  has 
been  obtained  under  a wide  variety  of  task  conditions  (87,94,134)  and 
retention  intervals  (10,14,130). 


Increased  levels  of  original  training  facilitate  retention,  but  is  it 
cost  effective  to  train  beyond  one  successful  performance,  or  is  such 
overtraining  excessive  and  wasteful? 


Overtraining,  or  mastery  training,  is  important,  and  it  may  be  more 
cost  effective  than  proficiency  training,  that  is,  training  to  some  mini- 
mally acceptable  level.  Mastery  training  is  known  to  enhance  retention 
(58,85,92).  This  is  a predictable  result,  but  it  has  important  implica- 
tions for  Army  training  policy.  Currently,  the  Army  relies  heavily  upon 
combinations  of  proficiency  training  and  refresher  training.  The  problem’ 
is  that  refresher  training  involves  time,  personnel,  and  equipment  costs 
that  cannot  be  minimized  without  first  minimizing  the  need  for  refresher 
training.  One  way  to  do  this  is  to  extend  original  training.  If  future 
research  should  show  that  retention  following  mastery  training  equals  or 
exceeds  retention  fo) lowing  an  equal  amount  of  proficiency  training  plus 
refresher  training,  a mastery  training  policy  would  appear  to  be  the  one 
to  adopt. 


The  benefits  of  mastery  training  extend  beyond  improved  retention. 
Theory  (4,31,45,65,66)  and  data  (27)  suggest  that  the  skilled  performer 
is  able  to  devote  less  of  his  total  attentional  capacity  to  an  ongoing 
task  than  the  novice.  Mastery  training  thus  frees  the  performer  eitiier 
to  attend  to  other  tasks  or  to  concentrate  upon  different  aspects  of  his 
main  task. 


Furthermore,  there  is  evidence  suggesting  that  mastery  training  may 
reduce  the  inhibitory  effects  of  anxiety-arousing  or  stressful  environ- 
ments upon  performance  (79) . Stated  another  way,  the  stressful  environ- 
ment that  may  distract  the  less-skilled  individual  and  disrupt  his 
performance  may  not  seriously  impair  the  highly  skilled  individual's 
performance.  If  this  hypothesis  is  supported  by  future  research,  it  has 
clear  implications  for  Army  training.  In  particular,  the  common  belief 
may  be  incorrect  that  troops  must  be  trained  under  simulated  combat  or 
other  generally  stressful  conditions  to  react  appropriately  when  placed 
in  an  actual  combat  situation.  Mastery  training  alone  may  protect  a 
soldier's  performance  from  the  interfering  effects  of  an  anxiety-arousing 
or  hostile  enyironment. 

Physical  practice  is  important  in  the  acquisition  and  performance  of 
motor  tasks.  However,  there  is  evidence  that  the  performance  of  some  mo- 
tor tasks  can  be  enhanced  as  much  or  more  by  "mental  practice"  (104,105). 
One  interpretation  for  this  effect  is  that  mental  practice  produces  activ- 
ity in  the  muscles  involved  in  the  performance  of  a task  and  that  this 
activity  transfers  positively  to  performance.  Although  this  interpreta- 
tion has  empirical  support  (105) , another  more  reasonable  interpretation 
is  available.  There  is  evidence  that  mental  practice  facilitates  the  cog- 
nitive, problem-solving  aspects  of  motor  learning.  For  example,  predom- 
inantly motor  tasks,  such  as  tracking  (128),  shov/  little  benefit  from 
mental  practice,  whereas  tasks  that  require  the  learner  to  depend  heavily 
upon  intellectual,  problem-solving  skills,  such  as  procedural  tasks  (105), 
generally  reveal  substantial  benefits  due  to  mental  practice. 


Also,  some  physical  practice  on  a task  enhances  the  effectiveness  of 
mental  practice.  As  physical  practice  continues,  however,  mental  prac- 
tice becomes  increasingly  less  effective  (122) . This  observation  is  con- 
sistent with  the  view  that  mental  practice  subserves  verbal-cognitive 
processing  during  motor  learning.  It  is  during  the  initial  stage  of  motor 
learning  that  verbal-cognitive  activity  is  assumed  to  be  prevalent  (4,45, 
65,66) . 


Although  clear  evidence  on  mental  practice  is  difficult  to  obtain 
(105),  closer  scrutiny  of  the  phenomenon  is  warranted.  If,  for  example, 
iri'=?ntal  practice  alternated  with  physical  practice  can  enhance  or  maintain 
performance  on  hazardous  tasks,  such  as  disarming  explosives,  or  infr*i- 
quently  performed  tasks,  such  as  launching  missiles,  the  potential  Jv^ne- 
fits  are  great. 


Refresher  Traininc 


Time  to  retrain  individuals  to  original  performance  levels  is  gener- 
ally rapid,  that  is,  consistently  less  than  50%  of  the  original  training 
time  (14,59,87).  However,  length  of  retraining  time  is  much  longer  for 
(a)  longer  retention  intervals  (14,95),  (b)  more  difficult  tasks  (73),  and 
(c)  for  procedural  tasks  rather  than  continuous  tasks  (14,59,87).  In 


addition,  highly  trained  individuals  tend  to  require  more  training  time 
to  regain  their  old  levels  of  proficiency  than  less-trained  individuals 
(14,87).  This  latter  result  requires  some  clarification.  Why  should 
forgetting  increase  with  training?  Although  this  effect  may  seem  counter- 
intuxtive,  it  concerns  forgetting  in  an  absolute  sense.  Because  highly 
trained  individuals  have  more  to  forget,  they  have  more  to  relearn. 


Several  investigations  using  military  personnel  have  demonstrated 
that  persons  with  practice  during  the  retention  interval  perform  better 
than  those  with  no  practice  (72,123,124,125).  For  example,  an  experiment 
examining  the  effects  of  various  practice  strategies  upon  the  long-term 
retention  of  simulated  manned  spacecraft  operations  (124)  showed  that  pe^-- 
formance  on  the  procedural  aspects  of  the  task  deteriorated  to  an  unaccept- 
able level  within  1 to  4 months  of  no  practice. 


At  the  end  of  1 month  of  no  practice,  trainees  required  five  times 
longer  to  complete  the  procedural  sequence  than  they  did  at  the  end  of 
training.  Additional  performance  decrements  were  not  evident  after  2 and 
3 months  of  no  practice.  However,  after  4 months  of  no  practice,  trainees 
required  17  times  more  time  to  complete  the  procedural  sequence  than  they 
did  at  the  end  of  initial  training.  In  sharp  contrast  to  these  data, 
trainees  afforded  some  form  of  practice  during  the  retention  interval 
showed  no  signs  of  losing  their  end-of-training  proficiency  levels  on  the 
procedural  sequence  over  retention  intervals  measured  up  to  6 months. 

Refresher  training  may  provide  opportunities  for  new  learning.  For 
illustration,  researchers  using  a team  of  aerospace  test  personnel  showed 
a substantial  improvement  over  original  training  levels  following 
refresher  training  13  weeks  after  original  training  (38) . 

Refresher  training  techniques  may  improve  on-the-job  safety  and  per- 
formance (38,51).  In  particular,  development  of  practice  modules  for 
safe  practice  of  a dangerous  or  critical  task  immediately  prior  to  actual 
task  execution  may  result  in  fewer  accidents  and  a higher  quality  output 
(123,124,125) . 

Warmup  Activity.  Closely  related  to  the  topic  of  refresher  training 
in  the  literature  on  the  e.'ects  of  a preparation,  or  warmup  period,  on 
retention  test  performance  (il7) . A warmup  period  can  promote  retention, 
but  it  depends  upon  the  particular  task  and  v/armup  activity.  Many  inter- 
vening activities  are  ineffective  as  warmup  activities,  and  some  result  in 
poorer  retention  than  a rest  period  (121).  More  research  is  needed  on  the 
effectiveness  of  various  warmup  activities  on  particular  tasks  to  clarify 
this  issue. 
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Some  evidence  (90)  suggests  that  "neutral"  tasks,  involving  activi- 
ties unrelated  to  the  task  to  be  recalled,  can  be  effective  as  warmup 
activities.  If  this  is  the  case,  it  has  practical  implications  for  the 
Army.  In  particular,  the  introduction  of  a neutral  warmup  activity  prior 
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to  the  performance  of  an  infrequently  performed,  such  as  launching  a 
missile,  or  dangerous  task,  such  as  combat,  may  prove  an  effective  means 
of  improving  performance. 


Transfer  of  Traininc 


Transfer  of  training  refers  to  the  influence  of  past  learning  on  new 
learning.  Learning  one  task  may  help  in  learning  or  performing  another 
task  (positive  transfer)  or  may  interfere  with  the  second  task  (negative 
transfer).  For  example,  the  responses  acquired  while  learning  to  drive 
an  automobile  may  alter  the  responses  one  makes  when  learning  to  drive  a 
tank.  Transfer  depends  upon  the  similarity  of  the  stimuli  and  responses 
involved  in  tasks  A and  B (61,62,63),  the  individual's  level  of  learning 
(1,42,61,75,78,145),  and  the  difficulty  of  the  tasks  (17,61,77). 

Positive  transfer  effects  are  observed  typically  when  transferring 
between  motor  tasks,  but  the  strength  of  the  effects  are  usually  small 
because  of  the  differences  between  tasks  and  because  of  the  effects  of 
forgetting  (1) . The  observation  of  negative  transfer  depends  primarily 
upon  how  it  is  defined  (23,61,62,63,75,80,82,117,145).  If  an  overall 
decrement  in  performance  is  required  for  negative  transfer,  then  the 
following  conclusions  are  justified:  Negative  transfer  is  difficult  to 
produce  and,  when  produced,  it  obtains  in  negligible  amounts  and  rapidly 
converts  to  positive  transfer  (23) . If,  however,  negative  transfer  is 
defined  in  terms  of  the  occurrence  of  an  occasional,  intrusive  wrong 
response,  then  it  may  be  a practical  concern.  Intrusion  errors,  although 
isolated,  can  occur  within  an  overall  context  of  positive  transfer  (75), 
and  these  errors  may  have  serious  consequences  for  the  human  operator  or 
the  equipment  being  operated.  Thus,  the  pilot  who  is  experienced  with 
one  aircraft  may  have  no  problem,  relative  to  the  complete  novice,  han- 
dling the  controls  of  a different  aircraft  up  to  the  point  when  a fatal 
error  is  caused  by  the  pilot's  previously  established  flight-control 
responses  (63) . Although  such  errors  can  be  avoided  by  training  within 
a controlled  environment,  such  as  uso  of  a simulator,  training  is 
required. 


Trace  Decay  and  Interference 

Trace  decay  and  interference  are  theories  of  forgetting.  Trace  decay 
theory  states  that  information  deteriorates  from  memory  solely  as  a func- 
tion of  time  (2) . One  study  indicates  that  information  about  discrete  mo- 
tor responses  starts  decaying  as  soon  as  it  enters  memory  (129).  However, 
there  is  no  evidence  about  the  decay  of  continuous  motor  information  and 
the  extent  to  which  trace  decay  influences  the  retention  of  motor  skill 
over  prolonged  no-practice  intervals. 


Interference  theory  states  that  forgetting  is  caused  by  competition 
from  responses  learned  either  before  or  after  a response  to  be  remembered. 
When  the  acquisition  of  task  A degrades  the  retention  of  task  B,  proactive 
interference  is  said  to  have  occurred.  The  acquisition  of  task  A also  may 
enhance  the  retention  of  task  B.  This  is  known  as  proactive  facilitation. 
The  inhibitory  effect  of  task  B on  the  retention  of  task  A is  known  as 
retroactive  interference.  The  converse  of  retroactive  interference  is 
known  as  retroactive  facilitation. 

Few  investigations  have  been  conducted  of  proactive  (43)  and  retro- 
active (75,80,82)  interference  that  used  motor  tasks  and  retention  inter- 
vals longer  than  a few  seconds-  Based  on  the  evidence  obtained,  it 
appears  that  interference  effects,  like  overc.ll  decrements  due  to  negative 
transfer,  are  difficult  to  produce  and,  when  produced,  persist  typically 
for  little  more  than  a handful  of  trials.  Also,  these  effects  appear  to 
be  restricted  to  situations  in  which  identical  stimuli  signal  antagonistic 
responses  (117) . Unless  two  tasks  employ  identical  stimuli  and  require 
antagonistic  responses,  facilitation  c ffects  can  be  anticipated  generally. 


Schedules  of  Practice 


Continuous  Tasks.  Learning  appears  to  be  slower  when  practice  ses- 
sions are  longer  and  heavily  massed  than  when  they  are  shorter  and  occur 
at  more  comfortable  intervals  (13) . However,  most  motor  learning  theo- 
rists (61,117,121)  are  reluctant  to  conclude  that  spaced  practice  is  more 
conducive  to  learning  and  retention  than  massed  practice.  Rather,  the 
theorists  contend  that  individuals  practicing  under  massed  conditions  may 
be  more  susceptible  to  the  effects  of  boredom  and  fatigue  than  those  prac- 
ticing under  spaced  conditions.  As  a result,  the  relatively  poor  perfor- 
mance of  individuals  in  the  massed  condition  may  not  reflect  the  amounts 
that  they  are  actually  learning.  To  support  this  contention,  a substan- 
tial body  of  evidence  (11,74,103)  indicates  that  persons  who  are  given 
rest  after  practicing  under  massed  conditions  can  demonstrate  levels  of 
learning  equivalent  to  those  achieved  by  individuals  practicing  under 
spaced  conditions. 

Although  there  is  generally  little  or  no  dissimilarity  in  the  reten- 
tion of  groups  trained  under  massed  and  spaced  practice  schedules,  an 
important  cautionary  note  is  necessary.  The  acquisition  of  dangerous  or 
highly  fatiguing  tasks  may  be  impaired  under  massed  practice  conditions 
(117) . That  is,  learning  and  performance  may  be  hindered  if  the  task  is 
too  dangerous  or  too  strenuous  to  be  attempted  repeatedly  in  the  absence 
of  rest.  In  support  of  this  hypothesis,  the  literature  on  vigilance 
indicates  that  humans  cannot  maintain  a high  level  of  performance  in  tasks 
that  require  continuous  sustained  attention  (32) . If  rest  opportunities 
are  not  provided,  individuals  lose  their  motivation  to  perform  or  show 
involuntary  lapses  of  attention.  If  these  lapses  of  attention  accumulate, 
they  may  hinder  the  early  learning  of  persons  in  the  massed  practice  con- 
dition relative  to  persons  in  the  spaced  practice  condition  (61) . 
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Discrete  Tasks.  In  contrast  to  continuous  tasks,  the  scheduling  of 
practice  apparently  affects  neither  the  acquisition  nor  performance  of 
discrete  tasks  (37,117).  No  data  are  available  concerning  the  effects  of 
different  practice  schedules  on  the  acquisition  and  performance  of  proce- 
dural tasks.  However,  it  is  likely  that  the  effects  of  distribution  are 
quite  small  and  relatively  unimportant  when  measured  against  the  influence 
of  other  learning  variables.  This  hypothesis  stems  from  both  the  observa- 
tion that  the  distribution  of  practice  typically  has  little  or  no  effect 
upon  the  acquisition  of  lists  of  verbal  items  having  some  degree  of  inter- 
nal organization  (138,139)  and  from  the  common  belief  that  the  motor 
responses  involved  in  most  procedural  tasks  have  a strong  verbal  component 
(2,117).  In  the  absence  of  further  research,  however,  there  is  no  way  to 
confirm  or  deny  this  hypothesis. 


In  summary,  the  manner  in  which  practice  occasions  are  arranged  tem- 
porally generally  does  not  have  a strong  effect  upon  individuals*  final 
level  of  original  learning.  The  number  of  practice  occasions  offered  is 
an  important  variable I Bierefore,  in  limited-duration  training  programs, 
better  retention  should  result  using  massed  rather  than  spaced  practice 
schedules.  The  fact  that  massing  allows  more  trials  per  unit  time  and 
hence  more  opportunity  for  initial  learning  is  the  basis  for  this 
interpretation  (23,117). 


Whole-  Versus  Part-Training  Methods 


The  trainee  may  learn  a task  by  practicing  the  entire  task  from  the 
beginning — whole  practice — or  by  dividing  the  task  into  a number  of  dis- 
crete parts — part  practice.  In  the  part-practice  situation,  the  3 earner 
practices  each  part  separately  or  in  conjunction  with  other  parts  and 
later  integrates  the  parts  to  form  the  whole  task.  Obviously,  there  is 
no  way  to  define  the  meaning  of  the  terms  part  or  whole  because  specifi- 
cation depends  upon  the  particular  task  (63 ) . 

Four  general  categories  of  variables  seem  to  have  an  effect  upon  the 
effectiveness  of  part-  versus  whole-training  loethods  (91) : 

1.  Task  to  be  learned,  for  example,  organization,  difficulty; 

2.  Learner  variables,  for  example,  intelligence,  age,  experience, 
preference; 

3.  Training  situation,  for  example,  amount  of  practice;  and 

4.  Performance  measures,  for  example,  time  or  trial  scores. 

Task  to  Be  Learned.  The  effectiveness  of  part-  as  opposed  to  whole- 
training methods  varies  with  the  difficulty  of  a task's  independent  sub- 
tasks and  the  degree  to  which  the  subtasks  are  interrelated  (53,61,117, 
121) : 


V . -i 


20 


1.  It  generally  is  easier  to  learn  simple  to  moderately  difficult 
tasks  using  whole-training  methods  rather  than  part-training 
methods,  whereas  the  opposite  is  true  for  more  difficult  tasks 
(121) . 

2.  Tasks  requiring  high  coordination  and  timing  of  tlieir  serial- 
motor  components  are  learned  faster  using  whole-training  methods. 
In  contrast,  part-training  methods  tend  to  be  more  effective  for 
tasks  that  can  be  divided  into  meaningful  independent  subtasks 
(30,93) . 


3.  There  appears  to  be  an  interaction  between  task  difficulty  and 
task  organization  that  influences  the  relative  effectiveness  of 
part-  and  whole-training  methods.  Thus,  training  for  tasks  of 
high  organization  becomes  increasingly  more  effective  with  whole 
practice  as  task  difficulty  increases.  On  the  other  hand,  train- 
ing for  tasks  of  low  organization  is  increasingly  improved  by 
part  practice  as  task  difficulty  increases  (91,93). 

Learner  Variables.  There  i-s  some  evidence  that  more  intelligent 
individuals  may  learn  and  hence  retain  more  using  whole-  rather  than  part- 
training methods.  Evidence  for  this  conclusion  comes  from  a study  of  the 
use  of  whole-  and  part-training  methods  to  teach  rifle  marksmanship  to 
Army  Basic  Trainees  (84) . Although  the  whole-training  method  was  found 
to  be  superior  in  slow-fire  routines  for  all  trainees,  the  more  difficult 
task  of  sustained  fire  was  facilitated  when  the  whole  method  for  only 
trainees  of  above-average  intelligence  was  used. 

Individuals  who  are  older  (school-age  subjects) , who  have  more  task- 
related  experience,  or  who  are  performing  a preferred  task  also  tend  to 
learn  faster  and  better  when  whole-  rather  than  part-training  methods  are 
used.  These  results  have  been  interpreted  in  terms  consistent  with  the 
hypothesis  that  less  difficult  tasks  are  more  amenable  to  whole-  rather 
than  to  part-training  methods  (91) . This  is  a reasonable  interpretation. 
Presumably,  a task  is  simpler  for  older,  more  intelligent,  or  nxsre  experi- 
'enced  persons.  To  the  extent  that  a person’s  preference  to  perfom  a par- 
ticular task  may  be  related  to  task  difficulty,  it  may  be  viewed  as  an- 
other condition  under  which  task  difficulty  influences  training-method 
effectiveness . 


Training  Situation.  As  training  continues,  learning  is  increasingly 
benefited  by  whole  practice  (91).  Apparently,  this  is  another  instance 
in  which  task  difficulty  is  the  variable  underlying  the  effect.  Practice 
facilitates  the  ease  of  a performance,  causing  later  learning  to  be  more 
amenable  to  whole-  than  to  part-training  methods. 


Performance  Measures.  Different  results  are  sometimes  obtained  when 
different  performance  measures  are  used.  In  particular,  time  scores  oc- 
casionally favor  part-training  methods  whereas  trial  measures  sometimes 
favor  the  whole  method.  However,  this  effect  appears  to  be  artif actual 
(91)  . 
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Part-Whole  Learning  and  Long-Term  Retention.  A search  of  the  whole- 
versus  part-training  method  literature  for  information  about  the  impact 
of  this  training  variable  upon  long-term  motor  memory  was  almost  in  vain. 
One  set  of  experiments  was  found  on  part-whole  learning  and  long-term  mo- 
tor memory  (112,113).  The  author  failed  to  show  any  differences,  however, 
between  conditions  during  original  learning  and  retention. 

Although  retention  should  benefit  from  the  training  method  that 
yields  the  higher  original  training  level,  both  part-  and  whole-training 
methods  may  produce  substantially  equivalent  training  outcomes  (112,113) . 
Under  these  conditions,  it  may  be  more  cost  effective  to  use  the  part 
method.  The  part  method  typically  employs,  or  can  employ,  simulators  (9) 
that  are  usually  lower  in  operating  costs,  more  adaptable  to  training 
requirements,  and  less  hazardous  to  the  operator  (140)  than  the  opera- 
tional equipment. 


Additional  Test  Trials  • 

Performance  tests  have  been  perceived  traditionally  as  tests  of 
learning  or  memory.  It  is  becoming  increasingly  clear,  however,  that  test 
trials  themselves  contribute  to  the  learning  process.  Evidence  concerning 
the  effects  of  additional  test  trials,  without  Icnowledge  of  results,  comes 
primarily  from  studies  of  verbal  memory;  at  least  two  conclusions  appear 
justified  on  the  basis  of  it. 
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1.  Memory  is  facilitated  greatly  by  the  addition  of  a test  trial 
given  prior  to  final  testing.  For  example,  investigators  studying  the 
long-term  retention  of  verbal  paired-associates  found  that  the  addition 
of  an  immediate  test,  after  10  paired  presentations  of  the  stimulus  and 
response  members  of  an  item,  reduced  error  frequency  by  nearly  50%  as  com- 
pared to  10  paired  presentations  without  the  retention  test.  In  addition, 
long-term  retention,  as  measured  by  the  individuals'  response  latencies  as 
well  as  their  error  frequencies,  showed  further  improvements  when  five 
test  trials  were  introduced  prior  to  the  final  retention  test  (12) . Con- 
verging support  for  this  conclusion  comes  from  a host  of  experiments,  many 
of  which  have  been  reviewed  elsewhere  (15,108).  In  general,  final  test 
performance  is  faster  (44),  more  accurate  (26,106,107),  and  more  stable 
(34),  and  relearning  is  quiclcer  (108)  when  additional  test  trials,  without 
knowledge  of  results,  are  provided. 

Evidence  is  lacking  concerning  the  effects  of  additional  test  trials, 
without  knowledge  of  results,  upon  the  retention  of  motor  skill.  Indeed, 
this  survey  uncovered  only  one  experiment  on  the  topic.  It  involved  the 
acquisition  and  retention  of  a simple  linear  movement  (41) . Contrary  to 
expectations  derived  from  the  verbal  learning  literature,  the  introduction 
of  additional  test  trials  during  the  retention  interval  did  not  aid  reten- 
tion. In  fact,  individuals  in  the  experimental  groups  became  increasingly 
less  accurate,  that  is,  more  variable,  over  successive  test  trials. 
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It  may  be  that  additional  test  trials  introduced  during  the  retention 
interval  do  not  enhance  motor  retention,  but  this  seems  very  unlikely.  As 
has  been  indicated,  additional  test  trials  have  clear,  beneficial  effects 
upon  the  retention  of  verbal  materials.  There  is  no  apparent  reason  to 
expect  that  these  effects  differ  across  response  classes.  It  would  seem 
more  likely  that  the  experimental  design  employed  by  these  authors  was 
incapable  of  identifying  the  effects  of  additional  test  trials  upon  motor 
retention.  More  research  on  this  issue  clearly  is  indicated. 

2.  Additional  test  trials  are  equally  if  not  more  beneficial  to 
learning  and  retention  than  study  opportunities.  A recent  experiment 
using  a verbal  memory  task  illustrates  the  effectiveness  of  additional 
test  trials  as  a variable  for  long-term  retention  (60).  Researchers 
tested  groups  of  individuals  for  the  retention  of  a list  of  words  after  a 
48-hour  retention  interval.  One  group  was  exposed  to  the  list  four  times 
before  the  final  retention  test,  that  is,  study-study-study-study- test. 

A second  group  received  a single  presentation  of  the  list  and  three  test 
trials  prior  to  the  final  retention  test,  that  is,  study-test- test- test- 
test.  Even  though  the  former  group  was  permitted  four  times  more  study 
time  on  the  list  than  the  latter,  the  final  retention  of  the  latter  group 
was  far  superior  to  that  of  the  former  group. 

A number  of  interpretations  have  been  offered  to  account  for  the 
facilitating  effect  of  additional  test  trials  on  the  retention  of  verbal 
material  (70) . Perhaps  the  most  plausible  of  these  is  that  additional 
test  trials  enhance  the  recovery  of  information  from  memory  either  by 
facilitating  its  organization  (28,40,111)  or  by  enabling  the  learner  to 
develop  a plan,  or  strategy,  to  retrieve  the  appropriate  information  at 
the  time  of  testing  (57) . It  is  also  likely  that  test  trials  help  the 
learner  to  determine  where  learning  is  incomplete.  Thus,  on  a given 
training  trial,  the  learner  may  recognize  material  he  missed  on  the  pre- 
vious test  trial  and  concentrate  on  that  rather  than  devote  further 
attention  to  previously  learned  material  (70,132). 

The  observation  that  additional  test  trials  may  be  more  beneficial 
to  learning  than  additional  study  time  has  important  practical  implica- 
tions for  training.  In  particular,  it  may  be  possible  to  reduce  overall 
training  time,  produce  a irore  effective  trainee,  or  both,  simply  by  af- 
fording the  trainee  more  test-taking  opportunities.  Tests  of  the  gener- 
ality of  this  hypothesis  are  necessary  to  determine  whether  additional 
test  trials  facilitate  the  retention  of  a wide  variety  of  tasks.  The 
Army  Research  Institute  has  begun  research  on  this  issue. 


SUMMARY 

This  review  is  based  upon  a wide  variety  of  data.  Although  military- 
related  findings  were  incorporated  wherever  possible,  some  of  the  experi- 
ments cited  used  tasks  having  little  direct  or  obvious  relationship  with 
skills  currently  maintained  within  the  Army.  In  addition,  conflicting 
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data  and  data  pertinent  to  a more  detailed  understanding  of  the  behavioral 
consequences  of  an  extended  no-practice  period  generally  were  skimmed  over 
to  lend  coherence  to  this  report.  In  so  doing,  an  oversimplified  picture 
of  long-term  motor  memory  and  the  variables  that  may  affect  it  has  been 
sketched.  These  constraints  notwithstanding,  a number  of  tentative  con- 
clusions have  empirical  support: 

1.  Discrete  motor  responses,  particularly  those  involved  in  pro- 
cedural tasks,  are  more  likely  to  be  forgotten  over  a no- 
practice period  than  are  continuous  motor  r-  sponses. 

2.  Retention  of  skill  is  a decreasing  fvinction  of  time,  and  the 
shape  of  the  function  depends  upon  a host  of  variables,  includ- 
ing the  length  of  the  no-practice  period,  the  type  of  task,  and 
the  availability  of  practice  or  the  presence  of  interfering 
activities  before  or  during  the  retention  interval. 

3.  Apparently,  learners  can  impose  organization  upon  psycholog- 
ically unstructured  tasks  via  the  learning  process.  As  a result, 
task  structure  is  not  an  important  variable  for  the  long-term 
retention  of  well-learned  responses,  although  it  is  an  important 
variable  for  the  retention  of  less  well-learned  responses. 

4.  Functional  similarity  is  a necessary  and  sufficient  condition 
for  learning  procedural  tasks. 

5.  Display-control  relationships  can  influence  the  ease  of  motor 
learning  and  transfer  and,  to  some  degree,  the  quality  of  per- 
formance after  a retention  interval. 

6.  Visual  cues  designed  to  supplement  the  information  provided  by 

a task  display  are  informative  early  in  learning  and  may  facili- 
tate the  learning  process.  Later  in  learning,  however,  these 
cues  become  relatively  .uninformative  and  unimportant  as  deter- 
miners of  retention. 

7.  Augniented  feedback  can  enhance  performance  by  enhancing  motiva- 
tion, learning,  or  both. 

8.  Individual  ability  levels  are  important  as  determiners  of  reten- 
tion insofar  as  they  influence  a person's  rate  of  learning  and 
final  level  of  performance.  Individuals  of  higher  initial  abil- 
ity tend  to  achieve  higher  levels  of  proficiency  and  retain  skill 
at  a higher  level  than  individuals  of  lower  initial  ability. 

9.  The  single  most  important  determinant  of  motor  retention  is 
level  of  original  learning.  Information  obtained  from  knowledge 
of  results  and  response-produced  feedback  is  thought  to  contrib- 
ute most  heavily  to  a trainee's  rate  of  learning  and  final  level 
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of  performance.  Information  provided  by  knowledge  of  results 
increases  with  its  availability  and  precision.  Information 
provided  by  response-produced  feedback  increases  with  its 
quantity,  for  example,  number  of  feedback  channels  and  amount 
of  practice,  and  quality,  that  is,  fidelity. 


Refresher  training  can  serve  as  an  effective  source  of  new 
learning  as  well  as  a means  for  reestablishing  forgotten 
responses.  Refresher  training  also  may  provide  a relatively 
simple  means  of  improving  on-the-job  safety  and  performance. 


11.  Learning  and  retention  are  benefited  by  test-taking 
opportunities . 

12.  Occasional,  intrusive  wrong  responses  induced  by  past  learning 
may  have  serious  consequences  for  the  human  operator  or  the 
equipment  he  is  operating. 


CONCLUSIONS 

Returning  to  the  main  issue:  What  procedures  can  the  Army  reason- 
ably use  to  insure  that  its  personnel  remain  job  proficient  over  pro- 
longed periods  of  no  practice? 

More  basic  and  applied  research  is  clearly  indicated.  Suggested 
during  the  course  of  this  review  were  a r umber  of  issues  and  avenues  for 
research  aimed  at  increasing  training  effectiveness.  Because  long-term 
retention  appears  to  depend  so  heavily  upon  a trainee's  original  learning 
level,  this  would  seem,  at  least  initially,  to  be  the  roost  direct  and 
effective  means  of  attacking  the  issue  of  skill  maintenance  in  the  Army. 

Stepping  up  research  efforts  is  not  all  that  needs  doing  to  foster 
a more  proficient  Army  trainee.  Research  has  value  but  only  insofar  as 
it  permits  inferences  to  be  drawn  about  tl.u  effects  of  particular  vari- 
ables upon  the  retention  of  particular  performances.  Research  does  not 
enable  one  to  determine  when  a given  individual  or  team  lacks  job  pro- 
ficiency. This  fact  is  of  fundamental  importance  if  the  Army  is  to  have 
a cost-effective  refresher  training  program. 

More  emphasis  must  be  placed  upon  the  use  of  local  individual  pro- 
ficiency examinations,  for  example,  some  more  frequently  administered 
variant  of  the  Skill  Qualification  Test.  This  would  seem  to  be  the  sim- 
plest and  most  economical  program  to  adopt.  Those  who  fail  to  demon- 
strate proficiency  can  receive  refresher  training  tailored  to  their  spe- 
cific needs.  Those  who  retain  their  proficiency  can  be  freed  for  other 
duties . 
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Individual  performance  evaluations  can  provide  other  benefits  to  the 
individual  trainee  as  well  as  to  those  in  supervisory  positions.  For  ex- 
ample, the  Job  Performance  Evaluation  program  currently  being  developed 
by  American  Telephone  and  Telegraph  Company  (56)  uses  a uniformly  applied 
set  of  performance  standards  to  judge  objectively  the  quantity  and  quality 
of  work  of  individual  employees.  The  employee  is  informed  exactly  what  he 
is  being  held  accountable  for  and  is  told  specifically  how  his  performance 
compares  with  management's  expectations.  As  a result,  the  employee  knows 
deficiencies  in  performance  and  can  modify  the  direction  and  level  of  his 
efforts. 

In  addition,  supervisors  receive  precise  information  about  the  pro- 
ductivity of  individual  subordinates  by  which  they  can  (a)  modify  and 
thereby  improve  training  programs;  (b)  increase  the  validity  of  procedures 
used  to  select  and  to  promote  employees;  and  (c)  improve  their  own  job 
performance  by  learning  more  about  the  progress  of  their  subordinates  as 
well  as  the  progress  of  their  work  group  as  a whole. 


The  assessment  of  American  Telephone  and  Telegraph's  evaluation 
program  is  only  beginning:  The  success  of  the  program  ro  date  is  based 
primarily  upon  anecdotal  reports  of  improved  employee  productivity  and 
morale.  Nevertheless,  their  program,  or  one  like  it,  appears  to  be  par- 
ticularly suited  to  many  Army  requirements  in  this  area  and  definitely 
warrants  the  Army's  consideration. 
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